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c6\[ering studies of teacher> school^ and program effectiveness, notes' 
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The public has ihaeasingl) demanded greater, "accountabilit)" of the ' 
public education sector m the last decade. In tht name of accountability, ' 
st'ate legislatures aaoss the country have been mandating minimal com- 
petenc>- testing programs for the public schools At the same .time, a 
"hold the line" attitiiie prevails, and several states have enacted tax and 
expenditure limitation provisions in*an effort to reduce governmental 
spending In addition, rapidly rising costs and double-digit inflation are 
creating senous fiscal problems' for local school districts everywhere / 
Soaring eneigy costs combined with reductions in state aid due to Cteclin- 
ing enrollments have already disrupted the budgetary process in many * 
school dist nets. 

With slower economic growth and very little "new" money available 
for education, budgets will continue to become tighter and more re- 
stricted" For the foreseeable future at least, administrators will be forced 
to seek out even more efficient and effective ways»of providing edtica- 
tional programs, A number ef studies which hav.e investigated school 
productivity and resource allocation can provide some direction and in- 
sights to help school administrators identify less efficient practices and 
procedures as they attempt to put limited resoutc&s to better use. The 
findings from school productivity studies conducted to date, such as 
cosl'-effectiveness analysis and school and teacher effectiveness studies, 
cannot pro vide quick and simple solutions for improving resource alloca- 
tion in schools They do,*however, offer some suggestions which'can be 
considered by local school districts to help contain school costs* 

School productivity studies are concemed with such issues as the con- 
sideration of alternatives, the importance of using time effioently, and 
the concept of opportunity cOsts A careful consideration of these issues ^ 
(S^n help makeexpliat the cost-effectivenes$ decisions that school adqtiin- ■ 
istrators intuitively make on a daily basis as they administer their 
» budgets 'Wiis pap^r discusses the general nature of school productivity 
studies, provides examples of* some cost-effectiveness d'nd school- 
effectiveness studies which might be useful, and addresses $ome of the 
problems inherent in measunng educational costs and assessing pro- 
gram effectiveness. This paper suggests thafschool administrators cart 
and do make a significant difference^ m determining school quality by 
applying school productivity research,' \ ^ . 

Cost-Effectiveness Approaches 

The concept of production function is crucial to understanding ty'pical 
school productivity and effectiveness research A production tunctioh 

expresses mathematically the relationship between school ipputs ^ that teachers play an important role in mnuencing pupil achievement, 

(e.g , studente, teachers, admimstrators, and curriculum matenals) and and that the manner in which school resources are mixed does make a 

school outpuMe.g., growth mco^^^^ merence in terms of^pupil achievement.^ These studies have also 

and affechve behavior) Withm this ana ytical framework, an attempt is pointed out that the use of time is of central importance in the educational 

made to determine the relative impact oj the different input variables on process. 

thet)utpu^ measures. In cost-effectiveness analysis, for example, the var- c i i * j i. ^tt . . j j 

lous inputs are priced, that is, a dollar value is attached to them. The Similarly, studies o teacher effectiveness have, tended to reinforce the 

outputs in any cost-effectivoaa-^Jf^m^J^lso b^ntif.able, buf~^°.'*^"'^^^'" i^^T^ Pf'^^t' ^" ^'"^'"^^ 
- - ^ f V number of these studies, Brophy notes that. 

5 of dollars. ' f ^ ^""^*^^=^3«<*«^z.U«* 

More effective teachers allocate moremlfh^rf time for teaching, 



g 4?udget level), or by achieving the same levej ot outjCTH^ith a lower 
level of input. In other words, use'fulandmeaningtui corr^ansonscanbe 
made between the co§t of different alternatives tor achieving a prescribed 
effectiveness level or between the eftectivenessJit different alternatives 
for a fixed budget lev^l* ' . , 

A major responsibility of school administrators is to structure and or- 
ganize the school resources at their disposal in an efficient manner to 
achieve the goals and objectives of^b^e school district School resource 
inputs consist of important human resources such as teachers, students, 
and staff and also -the material* resources such as the physical plant, 
classrooms, and cumcular products. In addition, human and matenal 
resources have to be combined or mixed to achieve the designated objec- 
tives wiihin certain constraints imposed by arcumstantial conditions 
such as state law requirements and collective bargaining agreements De- 
spite these constraints, administrators often havt more flexibihty than 
they realize in organizing and manipulating many key resources. 

In determining t}ie most effective resource mix, the instructional con- 
tent (e.g., reading* mathematics, language arts) as well as the instruc- 
tional process vanables (e.§., teacher characteristics, class size, length of 
school day) of the educational program are typically taken into account. 
In attempting to achieve performance objectives established for specific 
curriculum programs, a school staff makes, Several important decisions 
concerning resource use. How can the teachers' and students' time best 
be utilized? What types of student grouping, patterns will best facilitate' 
the learning proems? What type of cumculum materials should be used) 
School productivity studies such as cost-effectiveness analysis can, 
therefore, provide a structure for analyzing the complex relationship 
among school inputs, school processes, and school outputs and for exam- 
ining the different applicabje mixes of school resources in a more sys- 
tematic and objective manner In conducing cost-effectiveness analysis, 
the objectives to be attained are identified, the various instructional or 
other alternatives which lead to attainment of the objectives are consid- 
ered, and the costand effectiveness of each alternative are determined. 

Illustrative School Productivity Studies 

Numerous studies of school productivity have been conducted over 
the past'50 yeyars, and a number of models have been developed in the last 
decade for cost-effectivene?s studies.^ All cost-cffectivenes5 analyses 
stress the need to develop and €;xanvne different alternatives in a sys- 
tematic manner. Cost-effectiveness studies^conducted tp date suggest 



typically nt> attempt is made to equate them in terms ( 

In any production function computation, degree of e^ciency i& a term 
used to desCTibethe salient difference*or ratio bcfween school inputs and 
outputs. Thus, efficiency and productivity in an economic sense are mea- 
sured by the relationship between input and output in the school enter- 
prise. A school carp become more effiaent either by obtaining a higher 
level of output (e.g., student achievement), while holding input constant 



and spend^more of that time accordingly Effective teachers 
know how to organize and maintain a classroom learning environ- 
ment that maximizes the time spent engaged in productive activities 
and minjmizesthe time lost during transitions, periods of confusion, 
or disruptions that require disciplinary action. ^ 
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Several others Jia\e also discussed the positive relationship betvxeen "di- 
rect instruction" activities in the classroom and increased student learn- 
ing Lif basic skills •* Ke> to thes^ studies ii the clarity and specificity of 
what IS to be ieamed and tha effective and efficient use of teacher and 
student time in pursuit of these specific objectives Though studies are 
less dear about the relationship betvve(jn time use andpther, more highly 
held objective^, where "direct mstrucfton" may be less pedagogi'eally 
sound, for example, problem solving, discovery, synthesis, evaluation, 
creativity, it seems logical thattvpossible ITnk exists. 

In addition, sev era! cost-effe«iveness studies have consistently found 
teacher- related variables such as teacHTng experience, verbal ability, re^.' 
cency of the teacher's professional training, the extent to which teachers 
are involved in decision making, and the instructional strategies em- 
ployed by teachers to "be related significantly t^ student achievement 
•More recent school-effectiveness studies examining the schooling' pro- 
cess have begun to delineate the complex teacher- Student interaction ef- 
fects w hich occur irvlhe classroom These studies support th^ notion that 
certain t\'pes of children learn more vv hen matchjed witH certain types of 
teachers * 

Several studies have tocused on the cost-ettectiveness ^ Eleffientar% 
and Secondary Education ^^ct (ESEA) programs such as those for disad- 
V antaged students ^ Other studies have attempted fo compare the cost* 
associated With the more traditional instructional approaches with J^ose 
invoKmg educational technology, particuferl^ computer-assistefl and 

^ computer-managed programs ^ By investigating the cost consequences 
of using different input combinations such as teachers and computers, 
these studies ha v (^reinforced the importance of time and its use^ They ' 
• have often pointed tathe significant time savings obtained by students 
who are able to achiev'e similar achievement levels much more quickfy 
through the use of computer technology These studies also hav^ impli- 
cations for themannerin which teachers allocate their time in thefuturp 

Mong a somewhat different line, several school-effectiveness stucfies^ 
have tonsisten^ly found a strong relationship between teactier verbaf 
abihtv and student achievement " In one of the more interesting cost- 
effectiveness studies to date, Levm applied cost-effectiveness techniques 
m an analysis of teacher recruitment and retention policies ^Using a pro- 
du^on function approach, Levin investigated the impact of teachers' 
verbal ability a ncrteaching*^ experience on the performance of sixth grade 
students as measured by a standardized achievement test After examin- 
ing both the cost data and achieveq^ent results, Levin concluded that 
h'lnng teachers with higher verbal ability would be five to fen times more 
effective perdollar of expenditure m increasing student achievement ' 
scores than would hinng teachers with more expenence. 

. School effective ness stud ies have yielded some interesting findings as 
well Summers and Wolfe studied the academic progress ot 
approximately 2,000 students in 150 schools of the Philadelphia school ' 
system Using longitudinal data, they examined the achievement 
growth 6f individual pupils between the end ot the third and the sixth 
grades, the sixth and the eighth grades, and the ninth and the tweltth 
grades Summers and Wolfe concluded that schdkl inputs (such as 
teachers^and class size) ar\d school climate variables (such as social coip- 
positioh, achievement mixture, and disruptive incidences^exerted an 
impact on student achievement. In this study, ^11 t^pes of students 
(black, white, low a(jhievers, and high achievers) at all grade levels scored 
higher m achievement the more days they attended school. Elementary 
school' students also did better in smaller classes with teachers who 
graduated from 'higher- rated colleges. Low -achieving elementary siu-p 
dents did better with relatively l^ss experienced teachers,^ in smalleF 
classes, and in schools with mo^e high achieyers. On the other hand, 
high achievers did better with more experienced teachers. Apparentl/, 
speafic typesof students can be helped even more if particular types bf 
resources ai;echahneled to therfi 

'Mumane analy zed the impact of school i;esources,\specially teachers,^ 
on the cognitive achievement of approximately 900 black students m \£ 
schools m New Haven.'" He gathered data over a two-year period (sec: 
ond and third grades) for one group of children and over a one-year 
period (third grade) for another group. After examining the etfect of the 
classroona as a whole on ihe achievement of children, Mumane con- 
cluded that there are important differences in the amount of leaming that 
occurs in different classrooms within the same school and among dif- 
ferent schools, and that teachers exert a critical impact on student " 
"achievement He also'found, for example,, that black teachers with less 
^han'six years of experience taught reading to black children more effec- 
tively than dj<^white teachers with similar teaching experience. 

These two Studies ^disclosed sOitie important findings by using lon- 
gitudinal data and by*also^ing socioeconomic factors and specific school 
tesources to data ^n.individuAl pupils Many school resourcesftffect.dif- 
ferent types of students in different ways and few school resources ap- 
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pear to benefit all students equally Clearly , an important aspect ot the 
dynamic educational process is the unique interaction ^at takes place 
between certajHT types of school resources and certain ty^s ot students. 
Low -achieving students, tor example, appear to learn more with reia.- 
tlvely ine?^enenced teachers while high -achieving students seem to 
learn more with experienced teachers, Small classes apparently help low 
achiev ers but are not particularly important for av erage or high achievers. 
To determine if a new mdde ot instruction would be cost-effe€^ye for 

^/^low achievers, however, the n§t cost of less experienced teacher^ m 

' small classes vvould also hav e to be estimated While some students may 
leam more in smaller classes, ttie sue ohclasses is a major determinant ot 
school districts' budgets, and even a small across-the-board reduction ot 
two or three students per class could dramatically affect tFie costs in- 
volved. Ne\^rtheless, school administrators do have several options. A 
. recent synthesis of tlie research examining the ettects oi class size by 
€Iass and Smith suggests that pupil achievement increases as class size 
decre^igs." This research, however, indicates that there appears to be 
little c^fcge in pupil achievement vvhen reducing the size ot classes • 
which are larger than about 20 pupils, whereas there is evidence of Sub- 
stantial change m piipil achievement when reducmg'the size of classes 
which are smaller than 20 to 15 pupils. 

With most school districts maintaining an average class size ot 25 to 30 
pjupils, it would be fmancnally impossible to reduce all classes to a point 
somewhere below 15 pupils per teacher to promote significant changes m 
pupil aCTiievement At the same time, however, budgetary concerns 

..sViovild not necessarily mandate large classes of between 20 to 30 stu- 
dents. If a class size c>f 15 pupils represents the threshold at which 
achievement begins to rise rapidly, there are a number ot alternatives or 
possibilities for containing the costs involved ^ 

One alternative would be to vary systematically the size of Classes 
throughout the week, Insteadof havihg two classes of 25 pupils each, for 

, example, a-school might want one class of 40 pupils and another Ot 10 
puDils, to provide small group instruction to specific learners at least part 
of the week Similarly, it might be better to provide one 30-minute period 
w ith 10 pupils and another 90-minute period witTt^4p pupils than to have 
two 60-minute periods of 25 students e^h. Another alternative might be 
to provide a teacher's aide m eacb class of 30 students to produce the 
effect of ^ 15-pupii group. Yetanother possibility might involve the hiring 
of pa^t-time teachers for a staggered teaching-learning schedule. Regard- 
less of the particular. altemative.selectedeor policy adopted, class size 
s.hould depend on the interrelation s»hips among specific teacher charac- 
teristics, curncular areas, ai\d student abilities. 

Considering Opportunity Costs 

In conducting so^ool productiv ity studies important difficulties exist in 
measuring school costs ahQ school effectiveness. Those involved in de- 
velopment and implemejntation of school policies ^should be aware of 
these difficulties Several writer^ have addressed the potential pitfalls i;i 
conducting cost analyses within an educational context. Probably t)\^ ^ 
most useful notion that can be drawn from this work for administrators 
involves the concept of opportunity costs The developfnentand applica- 
tion of opportunity costs have substantially advanced our understanding 
of the input side of the educational process, and school costs are now 
typically viewed in terms of "what is given up" rather than "what is put 
m "The concept of opportunity cost& involves the jproblem of choice and * 
the exarfrtn^tion of alternative uses qf resources' If resources are con- 
sumed irt achieving one objective, they cannot be used to accomplish 
other purposes The real cost of any alternative, therefore, is the sacrifice 
incurred because the decision maker chose not to pursue i^me other al- 
temativ.e. 

In any cost analysis, thi* broad notion of costs has significar\t implica- 
tions for school administrators and must be carefully considered along 
with the more obvious direct expenditure items. Thomas has argued that 
^ the time spent within school might betteftfe governed by the principle of 
^"foregone learning."'^ In other words, the cost of a given instructional 
procedure Or of a given curriculum is measlired in part by foregone op- 
pc^unities to devote teachers' and students' time to other procedures 
and curricula Thus, administrative decisions involving the scheduling of 
teachers and students should treat the use of time as a scarce resource and 
allocate it accordingly. 

Administrators' actions may be significantly constrained by collective 
bargaining agreements and fixed safary schedules, but administrators do 
have discretion with regard to how teachers allocate their school time. 
Despite administrative ability to influence the variable of time, at least 
one school practitioner has asserted that. , 

Classrooms'" squander teacher talent. By assigning teachers and stu- 
dents to'boxes, we have made our schools grossly ineffipent. Fully 
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two-thirdsof a teacher's work m a classroom consists of maintenaflEe ' 
Items that could be performi?ti equally uell by nonprofessiopals. 
Although thib may be an uxerbtatement, a numbe» ut studies suggests 
that teachers could be used much morO effectively 
A stwdy by i^ossmiller and Geske, tor exctmple, tocubed on the use of 
' timi? by mstructional personnel and mvolved a sample of 36 elementary^ 
schools from nine states. '^Teachers in the schools sampled were asked to 
estimate the total amount ut ti me, both in school aru-l out ot school, that 
they devoted to their professional responsibilities and to indicate how 
much o*f that time went to instructional activities and how much went to 
nonmstructional activities An analysis of the data obtained for 96 
teachers disclosed that approximately 40 perc?|ft of their time was d6- 
^\ oted to nonmstructional activities These nonmstructional activities in- 
cluded supervision, planning^ testing, record keeping, and clerical and 
admin is t rative ta sks 

In another study, Hiatt focused on the use ot time by 25 primary 
teachttrs in urban and suburban Los Angeles who were representative oV 
thegerieral teaching population She tound that these teachers devoted 
a whopping 80 percent ot the morning class timL to noninstrucHonal ac- 
tivities Teachers, tor example, Mient rime evaluating student progress 
(22 percent), handling discipline problems (18 percent), and giving direc- 
tions (10 percent). The remainder of t]ie morning was taken up with yard 
duty , recess break, preparing material^ and equipment, *1nd c^jimmistra- 
tiveahd dericartiuties. 

Since salaries forhsschers typically constitute approximately 70 percent 
of a school district's- operating budget, many regard the classroona 
teacher as the most important single school resource over which adminis- 
trators can exercise some degree ot control. Given a consideration ot the 
opportunity costs involved, administrators will have to devise more ett/- 
cient staffing arrangements that utilize human resources, tor example, • 
teachers and paraprofessiop^ls, in such a way as to maximize the useot 
theirparticular qualifications, talents, and skills. * 

In this regard, computer technology can also be used effectively to re- 
duce substantially tlfe amount of time that teachers have to<levote to 
nonmstructional activities A number of school disti'icts are exploring the 
uses of miCTocomputers which are compact in size, relatively inexpen- 
sive, and easy to use. These microcomputers are ideally suited for use in " 
individual school^buildmgs and can accommodate records for 
approximately 1,000 students in 40 different cumcular areas Microcom-- 
puters, for example, can be used for storing mfc<rmation about iiRlividual 
^ student achievement on specific learning needs to form different instruc- 
tional clusters This technology can also be used for providing reports for 
diagnosing and prescribing learning activities, for producing group per- 
formance information, and for generating student progress reports for 
parents Microcomputec technology can also be Used to provide data and 
red^ice the time required to complete reports of mandated Individualized 
Education Plans OEPs) for special education programs 

DeveldpingEffect'i^eness Measures 

Traditionally, the focus m school financing has been on the input side, 
despite the fact that the doncept of efficiency also requires a careful exam- 
ination of the output side as welL The recent emphasis o/i efficiency and 
accountability in education, however, is prompting a much closer look at 
measuring educational outputs. In addition, some recent state supreme 
cqurt cases have begun to crftsider the equity implications of state sup- 
port programs m terms of ecfncational outputs-,*" In the coming years, it 
seems l^ely that educational organizations increasmgly will be required 
to consider the quality of their outputs and also to con sider the relation- 
ship betw een their outputs and the costs-involved. 

As IS true of the analysis'of school costs, the measurement of educa- 
tional outputs ir?yolves several difficult problems. To begin with there 
often IS di^reement with regard to the specific outcomes desired from 
an educaU5«4lsvstem and the relative importance of variou^outco 
Some people bclfete every high school graduate should possess , 
skill, others are primarily concemed that graduates be qualified ifi enter 
the college of their choice, still others are concemed that the schoj 
cate students with certain values and behavioral patterns. 

Educational s^^ems are expected to serve multiple and oftericMfTpet 
ing goals and obj^lves. Schools, for example, are urged to provfte stu 
dents with equal educational opportunities and, at the same time 
vide these opportunities and learning expenences in the most efficient 
manner possible. The dual objectives of equality and efficienc 
conflict with each other and usually involve^some type of trade-off. \du 
cational organizations often are confronted, ^or example, with choices 
that involve^reater equality at the expense of efficiency, orgreater effi- 
ciency at the expense of equality. 



While the etficiency cnterionls typically stressc*d in a cost-ettectiveness 
Mnaly SIS, the equity aspt^t of a program must alsi) be considered Since a ^ 
particular school program vviU'rarelv attect all student populations, tor 
vxample, low achievers and^lgh achievers, in an identical manner, an 
Lirtempt should be made to examine changes in the distribution c^f gains 
as well as overall g.^ms in test scores Techniques have been developed 
for treating^ultfple outcorpes in\ost-etfecli\eness studies, and gener- 
ally a single criterion of effectiveness cannot adequately detect and esti- 
mate alLpossible effects ot a program In tact, even the measurement of 
progres^ow ard attainment of a single otljectn e often w ill revfuvre the use 
of multiple indicators. 

The selection of Valid and reliable mstrumcnts is also an important con- 
sideration in measuring pupil pertormance Almost all standardised 
tests involve the conversion of raw scores into normative scores to indi- 
cate a student's relative position in a distribution of scores Grade- 
equivalent scores, fore\ample, indicate the grade lev el at w hich students 
" are performing Although grade-equivalent scores have some utility, 
Coleman and Karweit clearly point out that these scores cannot be used 
for making inferences about the effect of a khool program on the rates ot • 
growth of pupils who start at ^different grade lev els These researchers 
argue that a more accurate estirrjate of th^^^jmount ot change can be made 
by usmg standardize scores » 

While standardized tests descrfbt a studervt^ position rejalive to other 
students, they do not diagndse the specific sCiUs that ha\*e been mastered 
by the student For tl\is reason criteNon*-refer^nced tests (as opposed to 
•norm-referenced tests) appear to bt better suited for use in cost- 
effectiveness studies The distinguishiftg feature of a criterion -referenced 
^^st IS its relationship to the spec^jfic goals and subject matter of a program 
of mstruction Criterion- referenced test^, however, are not without prob- 
. lems These tests are developed to evafuate progress toward specific 
program objectives, but as mentioned earlier, widespread agreement on 
specific objectives is often difficult to achieve In addition, objectives are 
usually difficult to^operationalize in measMrable terms 

Conclusions ' v 

Most educational researchers and school administrators vvouldn-eadily 
agree that the processes which characteristically occur in educational or- 
ganizations and m human learning are extraordinarily complex' As yet 
there are no definitive and unequivocal answer^ to the difficult questions - 
about liow to improve resource allocations in education The work on 
school productivity and cost-effectiveneSs analysis conducted over the 
. past decade does, however, provide direction for .using school resources 
more effectively. The reviewed cost-effectiveness and school effects 
studies suggest seme important variables within the control of school 
administrators Among these are the use oftbachers' time, teacher vercbal 
ability,, and certain combinations of teachers and students These vari- 
ables seem to have an impact on student achievement. All are susceptible 
to manipulation by administrators and By the establishment of tjdufa- 
tional policy as part of the instructional process Despite some ohy(6us 
constraints such as collective bargaining agreements, school adminis- 
trators do have options th^t may be'exerased in an attempt to improve 
resource allocation in education. * * ^ . 

Given the tremendous pressures for fiscal restraint, school adminis- 
trators will need to consider even more carefully the manner In wKich 
teachers are selected and used in school districts Clearly, school admin-", 
Istrators will have to analyze and reassess the opportunity costs, as- 
soaated with the use of^acher time Teacher time that Is spent in super- 
vising playgrounds or stucfy halls is time that cannot be used in math 
classes or language arts classes. School administrators need to free 
teachers from numerous noninstructional activities which can be per- 
formed by community volunteers or paraprofe^ssionals. ' . ^ 
In V levv of the considerable differences'bnd variation among school dis- 
tricts across the country, school administrators are in key positions to 
yoffer insights and m^ke judgments abo^t what types of school resources 
|and efficiency practices will work best in their particular districts De- - 
pendmg on any number of district factors, for^xample, fiscal capacity, 
type of students, composition of teaching^fb^f^ange of ed^iCational of- 
ferings, an efficiency improvement that may b^sqpite suitable in one dis- 
tnct may be entirely inanpropriate m another organization. Admiriis- . 
trators who are familiar With the needs of their (^istriCts need to generate ' 
andexarttine vanoHsnrij^es ofschoo^resources Canadministra^lors make 

\ important difference in improving school productivity' The answer is - ; 
yes, and one way ib^Q more 'effective is by applyihg school' productivity 
research. . ' ' . 
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